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ABSTRACT 



1^ ■ We study a stochastic particle system which models the time evolution of the ranking of books 

lO ! by online bookstores (e.g., Amazon). In this system, particles are lined in a queue. Each particle 

jumps at random jump times to the top of the queue, and otherwise stays in the queue, being 

pushed toward the tail every time another particle jumps to the top. In an infinite particle limit, 
Pm . the random motion of each particle between its jumps converges to a deterministic trajectory. 

(This trajectory is actually observed in the ranking data on web sites.) We prove that the 
i-C ■ (random) empirical distribution of this particle system converges to a deterministic space-time 

C^ . dependent distribution. A core of the proof is the law of large numbers for dependent random 

variables. 
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1 Introduction. 

1.1 Definitions. 

Let (fi, B, P) be a probability space, and on this probability space we consider a stochastic ranking 
process {X]- (t) | t ^ 0, i = 1,2,- ■ ■ , N} of N particles, where X^ (t) is the ranking of particle 
i at time t, defined as follows. 

For each i assume that xl^ € {1, 2, • • • , N} and wl > are given, xl^ is the initial value of 

the ranking of the particle i; x- ^ = X^ (0) . We require that x-Q,i = l,2,---,N, are different 

numbers, or in other words, x^q , i = 1,2,- ■ ■ ,N, is a permutation of 1, 2, • • • , A^. w\ is the 
jump rate of the particle i. 

For each i let r^ • , j = 0, 1, 2, • • •, be an increasing sequence of random jump times, such that 
.(N) I ,_ n 1 o .' 1 .--1 o ... ^r ^^^;„A a^„. r.^A ^.... . . ^„..^„l„.^ J^) 



{r^ • I J = 0, 1, 2, • • •}, i = 1, 2, • • • , A^, are independent (independence among particles), t^q = 
and {t^ j^i ~ 'T'i j I J = Oi 1) 2, • • •} are i.i.d. with the law of r^ ="^11 being 

P[rf^) ^t] = l-e-'"-'^'*, i^O. (1) 



Note that with probability 1, r^ • , j = 0, 1, 2, • • •, is strictly increasing, and that r^ • / r^, ., for 
any different pair of suffices (i,j) 7^ {i' ■,]')■ 

For each i = l,2,---,A^we define the time evolution of X-~ by, 

where '^A denotes the number of elements in the set A, with [10 = 0, and for each j = 1, 2, 3, • • • 

X^^\t^^^) = 1 and 

Xf )(.) t W e {1, 2, . . . , AT} I 3/ e Z,; ^f) < 45 ^ n, ^f) < t < ^S, ^'^ 

Intuitively speaking, the definition says that particle i jumps at random times tjj to the top 
of the queue, and that after the jump it is pushed toward the tail every time another particle of 
larger ranking number jumps to the top. For example, let A^ = 4 and let the initial ranking be 
x^ Q = 2, X2 = 3, X3 Q = 1, ^4 = 4. In other words, particles 1-4 are initially aligned as 3124. 
For a sample uj such that 

< ri,i(a;) < T2,i{uj) < U^i{uj) < n,2(w) < • • • , 

the configuration evolves as 

3124 -^ 1324 -^ 2134 -^ 4213 -^ 1423 ^ •••, 

where the changes occur at each jump times Tij{uj). 

The stochastic ranking process may be viewed as a mathematical model of the time evolution 
of rankings such as that of books on the online bookstores' web (e.g., www.Amazon.co.jp). In 
this example, A^ stands for the total number of books, i represents a specific title of a book, w^ 
is the average rate with which the book i is sold, x^q is the initial position (ranking) of the book, 

r^ • is the random time at which the book i is sold for the j-th. time, and X^^ (t) is the ranking 
of the book i at time t. 

In the time interval (r^ ■ ,Tj • /j^) the ranking X^ (t) increases by 1 every time one of the 

books in the tail side of the ranking (i.e., with larger X^, (t)) is sold. In other words we have the 
following. 

Proposition 1 (^ and (0) are equivalent to the following: For each i, 



(it) for each i' / i and f = 1,2, • • •, if X^,''\4'^), - 0) < X^/\4'^), - 0) then X^''\4''J) = 

(Hi) otherwise X^ (t) is constant in t. O 

As seen in Proposition [H each particle jumps at random times to rank 1, and gradually moves 
to the right (increasing number) without outpacing any other particles on its right. This implies 
that for each t there is a boundary position x^ (t) E {0, 1, • • • , A^ — 1} such that all the particles 
on the left side have experienced a jump, and that none of the particles on the right has jumped 
by time t: 

xr\t)<.^^\t)^rrst, 
xr\t)^.^^\t)^rr>t. 

Xq (t) is a random variable and is explicitly written as: 

N 



1 — 



Put 

N ^ ^ ' N 



1 1 ^ 

y'c\t) = ^.Pit) = ^Xx^,.,^,. (5) 



■I — 



1.2 Motivation. 

We are interested in the large A^ limit of the stochastic ranking process. Noting that ([T]) implies 

(N) — ^.^h 

E[x (Jv)<, ] = P[rj St] = 1 — e ^i , the weak law of large numbers easily leads to the 
following: 

Proposition 2 Assume that the empirical distribution of jump rates converges to a probability 

distribution X: 

1 ^ 
X^^\dw) = j-^6{w-wf^)dw^\{dw), N^oo. (6) 



Then 
where 



lim iJq (t) =yc{t), in probability, 
yc{t) = 1- [ e-^'\{dw), t ^ 0. (7) 

JfO.ool 



O 



In the case of the online bookstore Amazon.com, the rankings seem to be defined in a more 
involved way, but the trajectories of rankings as predicted by Proposition [2] are actually observed 
at Amazon.co.jp [3l|4]. As may be seen from this example, the stochastic ranking process would 
be of increasing practical interest and significance in this age of online retails and web 2.0 [1]. 

In this paper we go further and prove that in the infinite particle limit N ^ oo, the random 
empirical distribution of the particle system converges to a deterministic space-time dependent 
distribution. To consider the limit A^ — ;• oo, it is natural to use the spacially scaled variables: 

y/^)(t) = l(xf)(t)-i). (8) 



Y^ (t) denotes the spacially scaled position of the particle i at time t, taking values in [0, 1) n 
N^ Z,. In the following, we will use Y^ (t) instead of X^ (t). Correspondingly, we will use 

for the initial configurations instead of x^ q . 

Theorem 3 (Theorem [6]) Under the assumptions on the initial configurations in Section \2.1l 
the joint random empirical distribution of jump rates (particle types) and positions associated with 
the stochastic ranking process {y^ } converges as N —)■ oo to a distribution (with deterministic 
time evolution). O 

See Theorem [6] in Section 12.21 for a precise form of the statement and an explicit form of the limit 
distribution. 

In the ranking of books, each time a book is sold its ranking jumps to 1, no matter how 
unpopular the book may be. At first thought one might guess that such a naive ranking will not 
be a good index for the popularity of books. But thinking more carefully, one notices that the 
well sold books (particles with large w\ , in our definition) are dominant near the top position, 
while books near the tail position are rarely sold. Hence, though the rankings of each book is 
stochastic and has sudden jumps, the spacial distribution of jump rates are more stable, with the 
ratio of books with large jump rate high near the top position and low near the tail position. 
Seen from the bookstore's side, it is not a specific book that really matters, but a totality of book 
sales that counts, so the evolution of distribution of jump rate should be important. An intuitive 
meaning of the Theorem is that we can make this intuition rigorous and precise, with an explicit 
form of the distribution for large N limit. 

The limit in the Theorem is mathematically non-trivial in that it involves the law of large 
numbers for dependent variables. Dependence occur because, for each particle i, the time evolution 
between the jump times r^ is a trajectory of a flow caused by the jumps of other particles in 
the tail side of the ranking, and the conditioning on tail side induces dependence of stochastic 
variables. 

The idea of considering such a limit theorem is mathematically motivated by the celebrated 
theory of hydro dynamic limits O El [3 [8] , although the dynamics (relaxation to equilibrium) and 
hence the proofs in Section [3] apparently have little in common (and are simpler). A difference 
lies in that the theory of hydrodynamic limits (among other things) evaluate the relaxation to 
equilibrium (invariant measures) through entropy and large deviation arguments via local equilib- 
rium, while the dynamics of the stochastic ranking process has a special feature that the queue of 
the particles consists of the 'tail' regime and the 'head' regime, such that the former is the queue 
of books which has not been sold up to time t, and having no dynamics for relaxation, keeps the 
remnant of initial data (Section 13. 3p . In contrast, in the 'head' regime the 'stationarity' is reached 
from the beginning (Section 13. 2p . It may also be worthwhile to note that our limit distributions, 
unlike the hydrodynamic limits which satisfy diffusion equations, satisfy non-local field equations 
(see remarks to Theorem [6] in Section [2]) . 

In Section [2] we state our main theorem and in Section [3] we give a proof. 

Acknowledgements. We thank the referee and the associate editor and Prof. K. Ishige for 
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results. 
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2 Main result. 

2.1 Assumptions on initial configuration. 

We consider the A^ ^ oo limit of the empirical distribution on the product space of jump rate 
and spacial position M+ x [0, 1), 

/xf V^, dy) = ^Yl '^("^ - ^f V(y - Yl^'Ht)) dw dy. (9) 

i 

We impose that the initial distribution 

i 

converges as A^ ^ oo uniformly in y to a probability distribution which is absolutely continuous 
with respect to the Lebesgue measure in y. (For the set of probability measures on ]R_|- x [0, 1) 
we work with the topology of weak convergence.) Explicitly, we assume that for each ^ y < 1 
there exists a probability measure fj,yfi{dw) on M+ such that for any bounded continuous function 

g : M+ — > R, the quantity / g{w)fiyfl{dw) is Lebesgue measurable in y and 

Jo 

1^^9{Wi)X(N)<^-j (/ g{w)^i:,fl[dw)\ dz =Q, (11) 



lim sup 

^^°°ye[0,l) 



i=l 



where (and also in the following) we use a notation XA which is 1 if A is true and if A is false. 
That each Hyfi{dw) is a probability measure on IR+ is consistent with p!T|) . which may be seen by 
letting g{'w) = 1, w ^ 0, in ([TT]) to find 

M^,o(M+) = l, 0Sy<i- (12) 

Note that A^^-* and A in ([B]) are the marginal distribution of fiy q and fiy^ of the jump rate; 

xW[dw) = -^6{w- wf^) dw = ^i\^\dw, [0, 1)), 

, -1 (13) 

\{dw) = / ixyfi{dw)dy. 
Jo 

Note also that (|lip and Fubini's Theorem imply ([UJ. 
We assume that the average of A is finite, 



wX{dw) < oo, (14) 

and 

A({0}) = 0. (15) 

This complets the assumptions for our main results. 

Remarks. (i) The assumption (fT4]) assures that /xo,t is well-defined (see (|24]l ). The main results 
on the existence of the infinite particle limit will hold without (I14p for y > 0, but we keep 
this assumption to include y = 0. 

(ii) We assume (fT5]l to assure that yc '■ [0, oo) — > [0, 1) defined in ([7]) is onto (see Proposition H]). 
The basic results in this paper will hold (with extra complexity in notations and arguments) 
without (jlSp , but we prefer to keep notations and arguments simple by keeping this assump- 
tion. (jlSp implies in the actual bookstore ranking, that 'all the books sell (almost surely)'. 
O 



2.2 Main theorem. 

With (jlSp . it is straightforward to show 



Proposition 4 Assume [T5\) . Then yc : [0, oo) — > [0, 1) defined in ([^ is a continuous, strictly 
increasing, bijective function of t. O 

Proposition m imphes the existence of the inverse function to : [0, 1) -^ [0, oo), satisfying 

(16) 



(17) 













yc{to{y)) -- 


= y, OS 


y<i, 




or 










y = i- [ 

Jo 


oo 


'Xidw). 






Differentiating 


dZD 


and 


m, 


we have 
















dye 
dt 


/■oo 

(t) = / we' 
Jo 


-™*A((iu;) 




1 




dto 
dy 


(ycit)) 



(18) 



We generalize ([7j) and define (with slight abuse of notations) 

/"l /"OO 

yciy,t) = l- / e-'"'^i,,o{dw)dz, t^O, OSy<l. (19) 

Jy Jo 

In particular, ycit) = yc(0,t). In the infinite particle limit, yc{y-,t) denotes the position of a 
particle at time t (if it does not jump up to time t) whose initial position is y (Proposition [8]) . 

Proposition 5 yc{'-,i) ■ [0,1) — > [ycit), I) *■? o, continuous, strictly increasing, bijective function 
ofy. O 

Proof. It is straightforward from the definition of yciy,t) in (fT9]) to see that yc{-,t) is continuous 
and non-decreasing in y. To see that it is strictly increasing, let ^ ^2 < 2:1 < 1 . Then (J19p 

pZl /'OO 

implies yc{zi,t) — yc{z2,t) = / e''^^^z,o{dw)dz. If this is 0, then ij,zfi{[0,M]) = for any 

Jz2 Jo 
M > 0, for a.e. z £ [z2,zi], which contradicts (fT2]) . D 



Proposition [5] implies that the inverse function y{-,t) : [yc{t), 1) -^ [0, 1) exists: 

^^'l /»oo 

y{y,t) Jo 
y{y,t) denotes the initial position of a particle located at y (> ycit)) at time t. It holds that 



f'l /»oo 

l-y= / e-'"V.,o(d^) dz, t ^ 0, yc{t) ^ y < I. (20) 

Jv(v.t) Jo 



^{y,t) = -^ ^ . (21) 

/ e '"^lXy{y,t),o{dw) 
Jo 

Now we return to our A^-particle process. 

Theorem 6 Consider the stochastic ranking process \Y^ } defined by ([TP and ([^j. Assume / [ij|) 
( fj^[ ) and / tJ5|) . T/ien t/ie joini empirical distribution of particle types and positions at time t 

^\''\dw,dy) = ^Y.^{w-wf^)5{y-Y^''\t))dwdy (22) 



converges as N ^ oo to a distribution ^y^t{dw) dy on M-|- x [0,1); for any hounded continuous 
function f : M+ x [0, 1) ^ M 



1- ^E/(-r^^/"^(^)) 

N^OD iV ^ — ' 



f{w,y)fiy^t{dw)] dy, in probability. 



(23) 



The limit distribution is absolutely continuous with respect to the Lebesgue measure on [0, 1) 
The density Hy^t{dw) with regard to y is given by 



fJ'y,t{d 



w] 



we 



-Wto 



(^)A(d- 



w) 



f 

Jo 



we 



-wto{y) 



-wt 



X{dw) 



lJ'y{y,t),oidw) 



-wt 



lJ"y(y,t),oidw) 



y < yc{t), 
y > yc{t). 



(24) 



O 



Remarks. (i) ([22]) and ^ imply A(^)(-) = ^Jii^\■, [0, 1)). Moreover, if in ^ we take / without 
y dependence and use ([6]), we have as a generahzation of (fT3l) 



A 



%,t dy. 



(25) 



(ii) Our results state that a random phenomenon approaches a deterministic one as the particle 
number N is increased. We state the results in terms of convergence in probability, but 
since the limit quantity is deterministic, this limit is equivalent to convergence in law. 

(iii) The explicit forms in (j24p differ drastically for y > yc{t) and y < yc{t)- As we have 
pointed out in the Introduction, and also as we will see in the proofs in the next section, 
the dynamics for large y and small y are totally different. 

(iv) By direct calculations, one sees that fj,y^t{dw) satisfies the following (non-local) equations: 



dfXy^tidw) d{v{y,t)ny^t{dw)) 



dt 



+ 



dy 



-Wfly^tid 



w] 



where 



v{y,t) 



w ^z,t{dw) dz 



dye 

oyc 
dt 



My)) 



y < ycit), 



iyiy,t),t), y>yc{t). 



(26) 



(27) 



The partial differential equation ()26p can be seen as the equations of continuity (conservation 
of mass) for the one-dimensional incompressible mixed fluids, with w standing for the rate 
of evaporation of specific type of fluid in the mixture [3j. v{y,t) is the velocity of the fluid at 
position y and time t, and (|27p. the source of non-locality, means that the flow is driven by 
evaporation. Intuitively, the equations are natural classical limit of the stochastic processes 
considered in this paper. 

In fact, we can directly prove (without referring to stochastic processes) that ()24p is the 
unique classical solution to the Cauchy problem of partial differential equation ()26p with 
suitable boundary conditions. See [3] for details. O 



3 Proof of Theorem [6]. 

It is sufficient to consider the case that / : M_|_ x [0, 1) ^ M in (f23l) is expressed as f{w,z) = 
g{w)Xz&[o,y\i with a bounded continuous function g : M_|_ — > M and < y < 1. Thus we prove in 
this section 



-1 ry rco 

J™ Tf^diWilXyW, ^ = dz g{w)fi^^tidw), in probabihty, (28) 

for any bounded continuous function g : M_|_ -^ M. 



3.1 Case 'y = yc{ty. 

Lemma 7 For each t > and each bounded continuous function g : M+ -^ M, it holds that 

jsl^^jvX^^^^i )^y/'^'(t)<y('^'(t) = / 9iw){'^-e''"^)X{dw), in probability, (29) 

and 



Proof. Since we have from ([5]) and the definition of Y- (t) 



O 



we have from ([T]) 



^y/'^'W^j^g^'W-^r'^^^t' (^^) 



,W^ 1 _ „f„.Xm\n ^-w';''h-, 



E[ 5K Ox^(iv)(,)^^(iv)(^) ] = g{wr>){l - e-> *). 



Since (7 is bounded, in a similar manner as the proof of Proposition [H we apply the weak law of 
large numbers to obtain 

ji'Zo ( iV E^^'^^^'^^^^^'/^'W^?/^'"^*) " NT.9i4''^)i^ - e'"'""'*) J = 0, in probability. 

With ^ we have (|29p. Next, Proposition [2] implies that, for any e > 0, with large enough A^, it 
holds that 

P[\yc{t)-yij''\t)\Se]>l-e. 

For such N, noting that 

N 

Yl l%/^){t)^yW{t) - %W(i)^j/c{t)' = E l^fe^7Vj/(f'(i) - ^fc^^J/cWl = ^\yc^\t) - yc{t)\ + 1, 

i k=l 

the probability of the event 

j 

is larger than 1 — e, thus the left-hand side converges to in probability as N ^ 00, which implies 
(El. □ 



3.2 Case y<yc{t). 

First note that, to prove ([28]) for y < yc(t), it is sufficient to prove that for each bounded 
continuous function g : ]R_|_ -^ M, 

hm - J]5(w^r)x^(iv),.< = / 5H(l-e-"'*"(^))A(d«;), in probabihty, (32) 

where to(2/) is as in (fT6]) . To see that ([32]) imphes (j28]) . differentiate the right-hand side of ([32]) 
with respect to y, use ([T8]) and ([T6]) . and integrate from to y, keeping in mind io(0) = 0, and 
finally rewrite using ^yt{dw) in ([M]) . to obtain 



1 ^^ , rAf^, P 



oo 

J™ ^I^5K^^^)XyWm< = / "^^-Too dz 







g{w)fiz,tidw) dz, in probability, 
J 

which gives ([28]) . 

To prove ([32]) . fix y < ycl*) and let to = *o(y) < *■ 

Denote by {Y^ ('^)''^j i / ^^^ scaled stochastic ranking process with the time origin shifted 
by the amount t — to > . Namely, let Y^ (s) = Y^ {s + t — to). In particular, we have 

i i 

For j = 0, 1, 2, • • •, define f^ • by f^ q = and 
where 

i(i.t — tf\\ ^ inf-f •? I -, 



j(i,t-to)=mf{j|T-if >t-to}- (35) 



Put, in analogy to ([5]), 

4 = 1 

Note that {tj ,+^ ~ '''i j I -^ ~ 0;1)2,-''} are independent and have exponential distributions. 
The loss of memory property of exponential distributions then implies that {f^^ • } have the same 



-(N). _ , r^(N). 



«J 



distributions as {r^ • }, and {1^ i^)} is a scaled stochastic ranking process with jump times 

{^i j } ^^d initial configuration {YJ (t — to)}- 

Since y = ycito), ([30]) for the time shifted ranking process implies 

lim --> (^(w )Xo(N),^ .^ = lim -r-ygiwl )Xo(n),^ .^ ,^ , 
= ^1™^ ]^ E5(^^'^ )Xy/-)(.o)^j/r'(*o)' ^"^ Probability. 



Using (|3ip for the original process and the time shifted process, and recalhng that {r^ } and 
{f^ } have the same distribution, and then using (j29p . we arrive at 

hm -T^y^ giwl )Xv(iv)., N<--(iv)., ^ = Mm -i^^/ oi'^l )X-(n)^. 

i i 

1 1 

i i 

roo 

= 5(u')(l-e-"'*n)A(dw), in probabihty. 

dSD dSSD and dSID together imply ([32]). 

3.3 Case y>ycit). 

First we make some preparations for the proof. We generalize y^ (t) in ([5]) and define (with 
slight abuse of notations) for ^ y < 1 

1 ^ 
yi^\y,t) =y + j^Y.KfHt>^y\'^,^^y- (3^) 

4 = 1 



Proposition 8 For ^ y < 1 and t ^ 0, 

lim ylj {y,t) = yc{y,t), in probability. (39) 

A''^oo 

Namely, the (random) position y^ ■^ (y, t) o/ a particle at time t whose initial position is y converges 
in probability to a deterministic trajectory yciy,t) defined by /119\) in the infinite particle limit. O 

Remark. The proof below shows that the convergence in ([39]) holds uniformly in y. O 



Proof. (pSl) and ([I]) and the independence of {r^ } imply 

E[ (yc(y,t)-y^^^(y,t))'] 

= yc{y,tf - 2yc{y,t) U + 1 ^(i - e-"''^'*)x^w^^ 

N 

i=l 

Af iV 

i=i i=i 

N 



+ i^E(l--"- --a--"- 'nx,;-,,. 



ll-e"" 
j=i 



2/c(y,i) 

4=1 



/ Af 

\ 1=1 



The second term in the right-hand side of the equation above vanishes in the N ^ oo hniit because 
of the factor N'^ in the denominator. Concerning the first term, as in the proof of Proposition [2] 
and Lemma [71 (jlip imphes that 

1 ^ (N) f^ r°° 

lim-^(l-e-« *W (-'>.= / / (l-e-"*Ko(rft«)cfz 

= 1-2/-/ / e-''^^^i^fl{dw)dz, 

Jy Jo 

uniformly in y. This combined with (J19p imphes that the first term also vanishes. Thus we have 



hm E[ iyciy,t)-y'^'\y,t)) ] = 0. 
With Chebyshev's inequality follows ([39]) . □ 

As an equivalent statement to (j28p . we will prove 



1 /■! /"oo 

n'^oo'n^^^^^ ^^y^^\t)>y^ \ ^^ 9{w)fiz,t{dw), in probability. (40) 

i y 

Let Q\ = {y > y(j (i)}- Then Proposition [2] implies that if y > yci't)^ 



lim F[nf^] = 1. (41) 

N—>oo 



For t > and y > yl^\t), let 



y(''\y,t) = mf{yl^^\i = l,-..,N, y/^)(t)>y}. (42) 

Note that 

\y-yi,''\y^''\y,t),t)\S^. (43) 

This follows because 

Yrit)=y^^(jji:p,t), .fyf)(t)>,(f)(t), (44) 

hence with y > y^ (t) 

2/-^^yg"^(2/(^n2/,0,0^>;^"^^(t) + ^ 

for alH with y/^^(t) > y. 

Until a particle jumps to the top of the queue, changes of its position are caused only by the 
jumps of other particles that sit on its right (Proposition [1]), hence 

i i 

Note that y^^'{y,t) depends on tj's. This means that the summands on the right-hand side are 
not independent random variables, and that we can not apply the law of large numbers as it 
is. In contrast, since y{y,t) is deterministic, the law of large numbers yields, as in the proofs of 
Proposition [2] and Lemma [Tj 

-I pi pQC 

J™ ^E^K M„{iv)>,.,. ,^X w)^ = / / g{w)e-'^^fj,z^oid'w)dz, in probability. (46) 

AT^oo iV ^ Vi.o =y(y<V -r- >t jAyi^y^t) Jo 



The right-hand side coincides with that of (j40p through a change of variables y(z, t) ^ z (note 
(f2TD). Combining (jlO]), ([H]), (jlS]) and ([MD, we see that it is sufficient to prove that 



lim P[y >yjf^(t), ^Vfi'l^i', 

/^CXD iV ^ ' 



(N). 



^y(^^'^j/(j,,t) ^yl^,^^ym{y,t) 



X,(iv)>, ^ e ] = (47) 



holds for any e G (0, 1). 

Note that if y > y'^\t) and \y''^\y,t) - y{y,t)\ ^ e, then 






(N), 



N 



<M(e + —) 



^yl^^^^yiy,t) Wl^^yW(y,t) 



Xn>t = AT Z^ 



^yl^,^my,t) WpWHy^t) 



where M > is a constant satisfying \g{w)\ ^ M for all lu ^ . Thus to prove (j47p . it is sufficient 
to show 



,W^ 



hm P[y>y^'^(t), |y^^^^(y, t) - y(y,i)| > 6 ] = 0, 

for an arbitrary e > 0. 

Let us assume otherwise, that is, with (|1T]) in mind, assume that there is ei > , p > and 
an increasing sequence of positive integers {Ni} such that 



,W)^ 



V[y>y)i:^>{t), y^''^^\y,t)-y{y,t)>e^]>p 



(48) 



or 

P[y > yjf^)(i), y(^>)(y,t) -y(y,t) < -ei ] > p 

holds. We consider the case ([I8|) . since the second case is dealt with similarly. Let yi = y{y,t) 
With Proposition [5l we have 

y = yc{yi, t) < yc{yi + ei, *)• 

Let £2 = yc{yi + ^i,t) — y > 0. Proposition [8] implies 



P[ |yW)(yi +ei,i) -yc(yi +6l,t)| ^ I ] ^ f 

holds for sufficiently large Ni. Combining (j48p . yi = y{y,t) and (j49p . we have 



(49) 



,W)/ 



m) 



£2 



P[y > y^'>^(t), yi + ei < y^''^Ky,t), \yP>{yi + e,,t) - yc{yi + e,,t)\ < 11 ] > ^ > 



W/ 



,W^ 



for sufficiently large N^. Note that (f38|) implies that if y ^ y' then y^ (y,i) ^ y^ iv'^t) + 



This combined with (j43p implies that if y > y^ (t) and yi + ei < y(^*)(y,t), then 



iV 



yjf^^(yi + .i,t)<y + | + |, 



£2 



for sufficiently large N^. On the other hand, if |y^ (yi + ei,t) — yc{yi + ^ij^l < -t; then 



,W)/ 



£2 



y + e2 =yc(yi + ei,i) < y^ '^yi + ei>*) + j 



(50) 



(51) 



But (j50|) and (|5T|) put together imply 



y + e2<y + | + |-, 



which is a contradiction for large N^. Thus the assumption (j48p is false, which completes the 
proof of Theorem [H 
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